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Abstract. Perhaps the most important problem in representation theory in 
the 1970s and early 1980s was the determination of the multiplicity of com- 
position factors in a Verma module. This problem was settled by the proof 
of the Kazhdan-Lusztig Conjecture which states that the multiplicities may 
be computed via Kazhdan-Lusztig polynomials. In this paper, we introduce 
signed Kazhdan-Lusztig polynomials, a variation of Kazhdan-Lusztig polyno- 
mials which encodes signature information in addition to composition factor 
multiplicities and Jantzen filtration level. Careful consideration of Gabber 
and Joseph's proof of Kazhdan and Lusztig's recursive formula for computing 
Kazhdan-Lusztig polynomials and an application of Jantzcn's determinant for- 
mula lead to a recursive formula for the signed Kazhdan-Lusztig polynomials. 
We use these polynomials to compute the signature of an invariant Hcrmitian 
form on an irreducible highest weight module. Such a formula has applications 
to unitarity testing. 



1. Introduction 

1.1. The Unitary Dual Problem. In the 1930s, I.M. Gelfand introduced a broad 
programme in abstract harmonic analysis which would permit the transfer of dif- 
ficult problems in areas as distinct from analysis as topology to more tractable 
problems in algebra. Fourier analysis is just one incarnation of this programme. 
An unresolved component in Gelfand's programme is the classification of the irre- 
ducible unitary representations of a group, known as the unitary dual problem. 

In the case of a real reductive Lie group, the problem is equivalent to identifying 
all irreducible Harish-Chandra modules which admit a positive definite invariant 
Hcrmitian form. As Harish-Chandra modules may be constructed via an algebraic 
method introduced by Zuckcrman in 1978 known as cohomological induction, it 
is of interest to study signatures of invariant Hcrmitian forms on cohomologically 
induced modules and to understand how positivity can fail. 

Cohomological induction is a two-step process in which we compose an induction 
functor with a Zuckcrman functor r*. The intermediate module in cohomological 
induction is a generalized Verma module which admits an invariant Hcrmitian form 
if the module to which induction was applied admits an invariant Hermitian form. 
Formulas for the signatures of invariant Hermitian forms on these intermediate 
modules may be used to compute signatures of forms on corresponding cohomo- 
logically induced modules (eg. |WaI84| L This motivates the study of invariant 
Hermitian forms on Verma modules (see |Wal84) . |Yee05j 'l and irreducible highest 
weight modules. 
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1.2. Overview. Let go be a real semisimple Lie algebra, 9 a Cartan involution 
of 0o, 0o = 6o © Po the corresponding Cartan decomposition, and ()o = to © Qo a 
0-stablc Cartan subalgebra and corresponding Cartan decomposition (recall that 
every Cartan subalgebra is conjugate to one which is 0-stable). We drop the sub- 
script to denote complcxification. A Hcrmitian form (•, •) on a g-module V is 
invariant if it satisfies 

(Xv, w ) + (v,Xw) = 

for every X £ g and every v, w £ V, where X denotes the complex conjugate of 
X with respect to the real form go of 0. In this paper, we develop a formula for 
the signature character of an invariant Hermitian form on an irreducible highest 
weight module of regular infinitesimal character when it exists and f) is compact. 
In the process, we present a survey of results concerning Verma modules and the 
Bcrnstein-Gelfand-Gelfand category O. 

We describe the organization of this paper. In section [2J we review formulas 
for signature characters of invariant Hcrmitian forms on Verma modules and their 
relation to the Jantzen filtration. In section we give a brief survey of the theory 
of Verma modules, define signed Kazhdan-Lusztig polynomials, and then express 
the signature character of an invariant Hermitian form on an irreducible highest 
weight module in terms of these polynomials ( Theorem 13 . 2 . 3|) . In section 01 we de- 
velop recursive formulas for computing signed Kazhdan-Lusztig polynomials when 
t) is compact (Theorem 14.6.1 0|) . We begin by treating the elementary cases. Next, 
we discuss category O, Jantzen's translation functors, Jantzen's determinant for- 
mula, and coherent continuation functors; we adapt classical results for contravari- 
ant forms to invariant Hermitian forms. Finally, we show how Gabber and Joseph's 
proof of the remaining "difficult" recursive formula for computing Kazhdan-Lusztig 
polynomials may be modified to complete a set of recursive formulas which may be 
used to compute signed Kazhdan-Lusztig polynomials. In sectional we compute 
some examples. Throughout this paper, the results typically only require existence 
of non-zero invariant Hcrmitian forms (thus f) must be maximally compact in addi- 
tion to 0-stable). However, we only know how to compute signed Kazhdan-Lusztig 
polynomials when \) is compact because in this case, it is easy to derive formulas for 
various quantities from analogous formulas for contravariant forms. We impose the 
additional condition of compactness on f) in: subsection l4.ll Lemma T4. 3. 41 Proposi- 
tion and any computations of inner products from subsection 14 .51 to the end 
of section 0] 

Acknowledgements. I would like to thank David Vogan for many helpful discus- 
sions, Joel Kamnitzer and Hannah Wachs for their hospitality, Alexander Postnikov 
for asking about irreducible highest weight modules during my thesis defence, and 
the referee for many helpful suggestions. 

2. Forms on Verma Modules and Filtrations 

2.1. The Signature of the Shapovalov Form on Irreducible Verma Mod- 
ules. We review the contents of |Yee05| . 

Let b = ()©ri be a Borel subalgebra of 0. Let A + (g, f)) be the set of positive roots 
determined by b and let p be one half the sum of the positive roots. For A € f)*, let 
M(A) = U(q) (8c;(b) Ca-p be the Verma module of highest weight A — p. We choose 
a generator v\- P for M(A). Given p G h*, Op is defined by (9p)(H) = p(9^ 1 H) 
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for every H in fj*. The complex conjugate of p, p, is defined by p(H) = p(H). 
We have the relation Op = —p, for p £ A r . The Verma module M(A) admits an 
invariant Hermitian form (•, •)> , which is unique up to a real scalar, when h, is 
maximally compact, #(A + (g, f))) = A + (g, f)) (recall that f) is 0-stable), and A takes 
imaginary values on f)o. Normalized so that (v\— p , v\- p ) x = 1, it is known as the 
Shapovalov form. Henceforth, we shall take f) and b to have the properties required 
for existence of invariant Hermitian forms. 

Define X* = —X for X £ g, and extend •* to an anti-involution of U(g) via 
(xy)* = y*x* for x,y £ U(q). Then 

(2-1.1) (xv X -p, yv\- p ) x = (A - p)(jp(y*x)) 

where p : U(g) — > t/(f)) is defined to be projection under the direct sum J7(g) = 
tf(fj) (n°P[/(fl) + C/(f|)n). 

Due to invariance, the Shapovalov form pairs the A — /i — p weight space of M(A) 
with the X — 6pj — p weight space. Recalling that Op = —p for p £ A r , we see that 
these are two distinct weight spaces when p is not imaginary, and they are the same 
weight space if p is imaginary. Finite dimensionality of these spaces allows us to 
discuss determinants and signatures of the Shapovalov form. 

A modification of the classical (invariant bilinear) Shapovalov determinant for- 
mula shows that when p is imaginary so that the weight space M(A)a_ m _ p is 
paired with itself, the determinant of a matrix representing the Shapovalov form 
on M{X)\- ll -p is 

OO 

n n« A '« v )-») p( ^ na) 

aeA+(o,[j) n=l 

up to multiplication by a scalar determined by the basis chosen. P denotes Kostant's 
partition function. 

When p is not imaginary (i.e. p ^ Op), the determinant of a matrix representing 
(•, -) A on M (A) A _ M _ P © M(A)A_e M _ p is 

oo 

11 ((A, a ) -n) ((A, a ) - n) 

aGA+(g,f)) "=1 

up to multiplication by a scalar. 

Since (M(A)a-j,- p , M(X)\- v - p ) x = when ^ is not imaginary, therefore for 
non-imaginary /i, the number of positive eigenvalues of a matrix representing the 
Shapovalov form on M(X)x- IJ/ -p®M(X)x-e p ,-p equals the number of negative eigen- 
values of that matrix (see Sublcmma 3.18 of Vog84 or p. 7 of |YeeQ5| ). Thus the 
signature of the Shapovalov form on M(A) may be recorded in a formal sum called 
the signature character as follows: 

ch s M(X) = (PO*) - ?(M))e A - M - p 

fj, imaginary 

where the signature of the form on M(A)a- p - p is (p(p),q(p)). Note that p(p)+q{p) 
is the dimension of M(A)a- p - p , whence the usual character formula when all the 
roots are imaginary (i.e. f) is compact) is 

chM(X)= ]T (p(p) + q(p))e x -»-". 

/i£A+ 
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The radical of the Shapovalov form is the unique maximal submodule of M(X), 
whence Verma modules are reducible precisely when the Shapovalov form is degen- 
erate. Thus Verma modules M(X) are reducible precisely on the affine hypcrplanes 
H a , n '■= {A | (A, a v ) = n} where a is a positive root and n G Z + . Within any 
region defined by these reducibility hypcrplanes, the signature of the Shapovalov 
form cannot change because the form remains non-degenerate. 

The largest region for which the signature does not change is the intersection of 
the negative open half spaces 



\aen / 



with H)q, where H a n := {A (A,a v ) < rt}, a v is the highest coroot, and II is the 
set of simple roots corresponding to our choice of A + . In |Wal84| , Wallach used an 
asymptotic argument to calculate the signature character of Verma modules M(A) 
with A in this region, which we refer to as the Wallach region: 

Theorem 2.1.1. Let imaginary X satisfying A| 0n =0 be in the Wallach region. 
Then the signature character of the Shapovalov form (■, -) A on M{X) is 

„A-p 

ch s M(X) = — — — . 

n a-^) n 

a£A+(p,t) a£A+(U) 

(In section 2 of |Yee05j , we discuss compatibility with the definition of the signa- 
ture character above.) The form taken by reducibility hypcrplanes suggests search- 
ing for a formula for the signature character in other regions which uses the affine 
Weyl group. In |Yee05| . we defined 

R(X) := c^~» 

for some constants c M given by Wallach's formula so that R(X) is the signature 
character of the Shapovalov form (•, when A lies in the Wallach region. We also 
defined and computed 

R A (X) := £ C y~» 

so that R A {X) is the signature character of the Shapovalov form (•,•)> when A 
belongs to the alcove A. We chose the fundamental Weyl chamber Co to be the 
antidominant chamber and the fundamental alcove Aq to be in the antidominant 
Weyl chamber. We computed the signature of the Shapovalov form within an alcove 
A by taking a path from A to a specific alcove in the Wallach region and computing 
changes to the signature character for each hyperplane crossed. We refer the reader 
to Theorem 13 . 2 . 41 of this paper or Theorem 4.6 of |Yee05| for a partial statement of 
the formula and to Theorem 6.12 of |Yee05j for the full formula. 

2.2. The Jantzen Filtration. As it is fundamental to our study of irreducible 
highest weight modules, we review the main tool used in computing how signatures 
change across a hyperplane: the Jantzen filtration. The Jantzen filtration corre- 
sponding to an analytic family of Hcrmitian forms {•, -) t , for t G {—8, $), on a finite 
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dimensional vector space E is the sequence of subspaces 

where e G E^ n ' for n > if there exists an analytic function f e : (— e, e) — > _E for 
some e > such that 

(1) /e(0) = e 

(2) (f e (t), e') t vanishes to order at least n at t = for any e' G -B. 

As weight spaces of a Verma module are finite dimensional, by taking an analytic 
path A( : [—8,5) — * H)q and corresponding Hcrmitian forms (•, -) A , we may discuss 
Jantzen filtrations of Verma modules. 
For e,e' G E< n \ define 

(e,eY = l™^(fe(t),fe>(t)} t 
which is independent of choice of f e and f e i . Then 

Theorem 2.2.1. f |Vog84| , Proposition 3.3) The form (■,•)" on E n is Hermitian 
with radical E^ nJr1 ^ , and therefore it induces a non-degenerate Hermitian form on 
Ei n \ := E^ n ' I E^ n+1 \ which we also denote (•,•)"• Let (p n ,Qn) be the signature of 
("i '}"; iPtO) be the signature of (•, -) t for t G (0,5), and (p',q') be the signature of 
(v) t for t G (-(5,0). TTien 




(pW) = I X! p " + X! 9n ' X! Pn + X! 9n ) • 

\n even n odd n odd n even / 

Consider an analytic path At such that Ao lies in exactly one reducibility hyper- 
plane, and At does not lie in any reducibility hyperplane for t =/= 0. Then 
M (Ao) has a unique proper non-trivial submodule: M(Ao — na) = M(s a Xo). It lies 
in an odd level of the Jantzen filtration, and therefore as one crosses the hyper- 
plane H a ^ n , the signature changes by the signature of an invariant Hermitian form 
on M(\q — na) and thus by plus or minus the signature of (•, •) Ao _„ a - We write 
this as 

R A {\) = R A ' (A) + 2s(A, A')R A - na {\ - na) 

for adjacent alcoves A and A' separated by the hyperplane H a n . e(A,A') is a 
function of the Weyl chamber containing A and A', a, and n. Its value may 
be found in |Yee05j . The relation above leads to the inductive formula for the 
signature character of the Shapovalov form on an irreducible Verma module which 
was mentioned previously 

Results which we wish to use are formulated in terms of the canonical Jantzen 
filtration and so we review this classical concept and investigate relations to our 
version of the Jantzen filtration. 

We use the setup of |(xJ81j since we will follow sections of it closely. Let 
{X a , Y a | a G A+(g, t))} U {H a \ a G 11} be the Chevalley basis for g. We let g z 
be the integer span of the Chevalley basis. It is a Lie algebra. f)z, nz, n^, and bz 
are the obvious analogues. We let A be the local ring C [t], t y For the Lie algebra 
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az, define a a to be az ®i A. Jantzen defines U(n op )z to be the Z-subalgebra gener- 
ated by Ya t n = Y™/n\ where a G A + (g, t)) and n > 0. For a highest weight module 
E with primitive generator v for which (v, v) = 1, define E% to be U(n op )iv. 

Given A G f)^, we let A\ be the one dimensional C/(t)A)-module on which G f) 
acts by multiplication by \{H). Extending A\ to a L/(b a) -module by allowing 
X G riA to act by zero, we define the Verma module over U(qa) by M(X)a '■= 

U(qa) ®u(b A ) a x-p- 

There is an involutive antiautomorphism a of g so that u(H) = H for all H G fj 

and such that cr(X a ) = Y a for every positive root a. It may be extended to an 

antiautomorphism of U(q) in the same way that •* was. This leads to the canonical 

contravariant forms, denoted by (•, •), on U(g) and U(qa) Verma modules with the 

defining properties that the forms are symmetric, bilinear, and (xv, w) = (w, <j(x)w) 

for all x in the universal enveloping algebra and all elements v,w of the Verma 

module. Thus (•, •) on M(X) or M(X)a satisfies 

(2.2.1) {xvx-p, yv\- p ) = (A - p)(p(a(y)x)). 

Compare this with (|2.1.1|l . 

Consider the [7({u)-module M = M(A + St) a where A G f)* and <5 G f)* are 
regular and imaginary. The Jantzen filtration of M(A + <5t) J 4 is defined to be 

M (0) D M (D D ... D M (N) = {Q} 

where = {w G A/ | (w, w) G (P)Vw G M}. This is a filtration of M(A + ft)^ 

by [/(g^) modules. We get a filtration on the module M := M/tM, which is 
isomorphic to the U(g) Verma module M(A), via = M^/(tM l~l M®). It is 
the usual Jantzen filtration of M(A) and does not depend on the value of regular 5: 
in |Bar83| , Barbasch showed for an arbitrary non-degenerate deformation direction 
that the Jantzen filtration coincides with the socle filtration. We define Mr*) and 
M(j) as in the Hcrmitian case. 

Lemma 2.2.2. Let M(A)^ be the j th level of the Jantzen filtration defined by the 
path At = A + St. Then 

M(A) W = M(A)°>. 
Proof. Note that (A + 5t - p){y*x) = (X + St- p)(a(a(y*))x) so that 

{xv x+ 8t-p,yv\+8t-p) x+St = { xv \+St-p,v(y*)v\+8t-p)- 

The lemma now follows from the two definitions of the Jantzen filtration and the 
observation that •* and a are bijections from U(g) to U(g). □ 

Henceforth, bar will denote specialization at t = 0. For the remainder of this 
paper, we use the classical Jantzen filtration of a Verma module and use j inter- 
changeably with (j) and with (j). 

3. Verma modules and Kazhdan-Lusztig polynomials 

3.1. A Brief Overview of Verma Modules. The structure of Verma modules 
has been studied by a number of people (eg. |Ver68| . |BGC71j . |DL77j . |Jan79j . 
[BB93] 'I. 

Theorem 3.1.1. (cf. |Uix96| Theorem 7.6.6) 

dimHom (M(A), M(/i)) < 1 for all A, p G (f . 
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Theorem 3.1.2. (Bernstein-Gelfand-Gelfand, |Dix96j Theorem 7.6.23) ForX 7 fi 6 
ff, 

Af(/x) C M(A) <==^ 3ai,--- , a m e A + (g,F)) suc/i i/iai 
A > s ai A > ■ • • > ,s Qm • ■ ■ s ai A = fx. 

(Recall that for Hi, H2 S f)*, Mi ^ M2 if & n d only if fi2 — \i\ G A+.j 

Remark 3.1.3. The above conditions may not be equivalent to /1 6 VFA and fi < X. 

Vcrma modules have finite composition scries. The composition factors of M(A) 
are L(^) where M(/x) C M(A) (cf. |Dix96| . Theorem 7.6.23). In |DL77| . Deodhar 
and Lepowsky showed that although dimHom B (M(^), M (A)) < 1, it is possible 
for a composition factor of a Verma module to have multiplicity greater than one. 
In |KL79| . Kazhdan and Lusztig defined polynomials P XtV for x,y € W known as 
Kazhdan-Lusztig polynomials. They famously conjectured that for A antidominant 
and regular and for x and y in the integral Wcyl group W\ with longest element w\ , 
the polynomials give the multiplicity of L{y\) as a composition factor of M(xX): 

[M(xX):L(yX)}=P WxXtWxy (l) 

from which we obtain 

(3.1.1) chM{xX) = P WxX , Wxy (l)chL(yX). 

y<x 

Furthermore, the multiplicity of L(yX) in the j th level of the Jantzen filtration of 
M{xX) is encoded by Kazhdan-Lusztig polynomials: 

(3.1.2) [M(xX)j : L(yX)} = the coefficient of g^MM-i)/ 3 in P WxX , WxV . 

A proof of the Kazhdan-Lusztig Conjecture was perhaps the most important 
open problem in representation theory in the early 1980s. In |Vog79b| , Vogan 
showed that semisimplicity of U a L(xX), where U a L(xX) is defined to be the co- 
homology of the complex — > L(xX) — > 6 a L(xX) — > L(xX) — > 0, implies the 
Kazhdan-Lusztig Conjecture. In |CJ81j . Gabber and Joseph proved that Vogan 's 
Conjecture follows from Jantzen's Conjecture: 

M(xXy = M(xs a Xy +1 DM(xX) 

for j > 0, x e W\, xs a > x, and a 6 II such that (A, a v ) <E Z. Brylinski, 
Kashiwara. Beilinson, and Bernstein were able to prove the Kazhdan-Lusztig Con- 
jecture by studying the relation between Kazhdan-Lusztig polynomials and Deligne, 
Goresky, and MacPherson's intersection cohomology ( BK81 , BB81 ). Beilinson 
and Bernstein subsequently proved Jantzen's Conjecture ( |BB93) ^1 using stronger 
versions of these techniques. 

3.2. A formula for ch s L(xX) in terms of signed Kazhdan-Lusztig poly- 
nomials. Because the radical of the Shapovalov form on M(xX) is M(xA) 1 and 
L(xX) = M(xX)o = M(xX)/M(xX) 1 , therefore the Shapovalov form on the Verma 
module descends to an invariant Hermitian form, which we also call the Shapo- 
valov form, on the irreducible highest weight module L(xX). Their signatures differ 
only by zero eigenvalues. We write ch s L(xX) for the signature character of the 
Shapovalov form on L(xX). (We implicitly assume here that xX is imaginary.) 
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From equation one obtains the inversion formula 

chL(xX) = ^{-iyW-^P y , x (l)chM(y\) 

y<x 



(cf. |KL79| ~I. Because we do not know the value of ch s M(yX) when M(y\) 
is reducible, we cannot compute signature characters from the above formula. 
However, we may make use of our knowledge of signature characters for alcoves 
which contain xX in their closures. To illustrate this, consider the simple ex- 
ample of a; A such that only the adjacent alcoves A and A' contain xX in their 
closures. Let H a n be the rcducibility hyperplane containing xX. Recall that as 
one crosses the hyperplane H a n at xX, the signature changes by the signature of 
M(xX — na) = M(s a xX) = L(s a x\). Wc conclude that the signature characters 
for the alcoves A and A' evaluated at the point xX are ch s L{xX) ± ch s L{s a xX) in 

some order so that -k (R A (xX)+R A '{xX)^ = ch s L(xX). We have formulas for R 

and for R A , and so we have expressed ch s L(xX) in terms of known quantities. 

We now consider the general case. Take the path At = xX + St, where 8 is regular 
and imaginary, and consider the Jantzen filtration of M(xX) which it defines. Now 
M(xX)j is semisimple (cf. |GJ81| Theorem 4.8 (ii) ) and (•, ■) ■ is a non-degenerate 
invariant Hcrmitian form on M (xX)j . The contribution to the signature character of 
(-, -)j by a particular irreducible constituent L(yX) of M(xX)j is either the signature 
character of the Shapovalov form, the negative of it, or zero because L(yX) is paired 
with L(6yX) (which may be another copy of L(yX)). Recording which of the three 
choices occurs for each composition factor with +1, —1, or 0, we have 

(3-2.1) ch s (; ■) j = J2 ^l., Wxy ^h s L{yX) 

y<x 

for some integers a^ x Wxy ■. Since signatures cannot change in the interior of an 
alcove, we will let w{5) <G W\ be such that 6 6 w(5)€q and we will write a*'^.^ j 
in place of a^] xX Wxy j We record these integers in polynomials 

j>0 

which we call the signed Kazhdan-Lusztig polynomials. We remind the reader 
that the signed Kazhdan-Lusztig polynomials above are indexed by a regular an- 
tidomininant weight A and by elements w, x, and y of W\. 

Remark 3.2.1. Note that the usual Kazhdan-Lusztig polynomials are defined in the 
same way, but with contributions of +1 to coefficients for every composition factor 
rather than +1, —1, or 0. Therefore 



X,w 



< [M(wX)j : L(yX)} = coefficient of q Wx) -^ y) - j)/2 in P t 



Let j4(xA, w(S)) be the alcove containing xX + St for regular, imaginary 6 and 
for small t > 0. Using our formulas above and Theorem 12. 2. II 
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Remark 3.2.2. When yX is not imaginary, neither M(yX) nor L{yX) admit non-zero 
invariant Hermitian forms, whence ch s L(y\) is undefined. However, in this case, 

each L(yX) is paired with some L(9yX) , giving us a^xfw x y,j = ^ anc * Pw\*,w\y = 
(see our discussion in the previous section concerning non-imaginary weights). The 
sum above ought to be over y such that yX is imaginary to avoid abuse of notation. 

Observe that P^% x (q) = a^j^x.o = and so 

ch s L(xX) = R A ^ s »(xX) - P^ w x { Xy(l)ch s L(yX). 

yX imaginary 

Applying this formula recursively, we arrive at: 

Theorem 3.2.3. If X £ f)* is regular and antidominant, then for x £ W\ such that 
xX is imaginary and for any w £ W\ : 

ch s L{xX) = (n^l,^-^ 1 )) R A[viX ' w) {y^)- 

y\< - ■ ■ <yj=x \i—2 / 

ykX's imaginary 

We recall the formula for R A ^ lX - w \ Vl X): 

Theorem 3.2.4. ( Ycc05 ], Theorems 4-6 and 6.12) Let A+(g, ()) be the set of imag- 
inary roots in A + (g, t)). Subscripts or superscripts i will refer to objects associated 
with A+(g, h). We will assume that everything (simple roots, reducibility hyper- 
planes, etc.) in this theorem is associated to the root system of imaginary roots. 
Choose the fundamental alcove A of W % a and the fundamental chamber Cq of Wi 
to contain —pi- Let' : W' l a — > Wi be the homomorphism arising from the semidirect 
product structure W l a = Wi k A, . Given a £ , letaG Wi be such that aA l £ a£ . 
Let o^4q = Co — * Ci ^ • • ■ -4- d = aA l be a path from aA l to <L4 . Then for 
imaginary X £ Aq: 

ch s M(X)\ aa = X\ ao and 
ch s M(X)\ to = R aA °(Mio) 



S=Ul<-i fc } 
C{l,...,i] 



rLeA+(p : t)(l _ e c ")riaeA+(t,t)( 1 + e a ) 



wheree(S) = e{C ll -i,C il )e{T~C i2 ^ 1 ,r~C i2 ) ■ ■ ■ e(r~ ■ ■ ■ r~C ik ^i,r~- ■■r~C ik ), 
e(0) = 1, and the formula for e{C, C) for alcoves C, C may be found in Theorem 
6.12 of IYee()5| . 

Since we have formulas for R A for any alcove A, therefore we can compute 
ch s L(xX) as long as we can compute the integers P^'^ wxy (1). 

4. Recursive Formulas for computing signed Kazhdan-Lusztig 

polynomials 

4.1. Recursive formulas for the easy cases. The usual Kazhdan-Lusztig poly- 
nomials may be computed via P x , x = 1, Px,y = when x > y, and by the recursive 
formulas: 

a) P Wx x,w xy = P Wx xs,w xy if ys > y and x,xs >y,s simple, 
a') Pw x x,w x y — Pw x sx,w x y if sy > y and x, sx > y, s simple. 
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b) If y > ys then 

/j,{w\z,w\y)q 2 Pw x x,wxz 

H 1 w\xs,w\y T q l w\x,w\y — z£W-y\zs>z 

+Pw\x,w x ys 

where c = 1 if xs < x, c = if xs > x, and fi(w\z, w\y) is the multiplicity 

of L(yX) in M(z\)±. 
The initial conditions for signed Kazhdan-Lusztig polynomials are identical: 
Px'x = 1 an( i Px'y' ~ when x > y. We will find the recursive formulas to 
be different. 

We discuss the signed Kazhdan-Lusztig polynomial analogue of '). We 

assume the Cartan subalgebra rj to be not only maximally compact but compact 
for this subsection. Thus yX = 0(yX) for all y G W\. Choose x, y G W\ and 
s = s a simple so that sy > y and sx > x. Recall that A is regular antidominant. 
We consider the Jantzen filtration corresponding to the path X f = xX + St where 
S G w€q and we restrict our attention to L(yX) in the j + 1 st level of M (sxX). Since 
sx > x, therefore (xX,a v ) > 0, whence M(xX) is a submodule of M(sxX). The 
Jantzen Conjecture and our recursive formula a') tell us that all copies of L(yX) 
in the j + 1 st level of the filtration arise from the submodule M (xX) of M(sxX). 
Similarly, if xs > x and ys > y then all copies of L(yX) in the j + 1 st level of 
the Jantzen filtration of M(xsX) arise from the submodule M(xX) of M(sxX). Wc 
obtain: 

Proposition 4.1.1. Let s = s a be a simple reflection and let y < x. 

a ) a wxx,w xy ,j+\ = sgn{-wp,xa)e(H xaAxsXtXa y ) ,xs)a^ X Wxy :j if xs > x 
a ') a wZx,w xy ,j+i = sgn(-wp,a)e( J ff Q , (sxA , Q v ) ,sx)a^ A " J 2 ,^ Ayj if sx > x. 

Proof. Recall that e(A,A') is a function of the Weyl chamber containing A and 
A' and the hyperplane which separates them. We therefore defined e(i? 7i jv, z) for 
z G W in [Vro()")| . Take an analytic path Xt : (— e,e) — > H)q in the Weyl chamber 
z£q so that A t G UT n f° r t > 0, X t E H~ N for t < 0, H^_n is the only reducibility 
hyperplane containing Ao, and M(X t ) is irreducible for t ^ 0. Let t\ G (0, e) and 
let t 2 G (-£,0). Recall that 

ch s M{X tl ) = e Xt i- Xt2 ch s M(X t2 ) + 2e(H 7 , N ,z)e Xt i- Xa ch s M(X - iV 7 ) 

which reflects the change of the signature character by the signature character of 
the radical M(Xq — Nj) C M(Ao) as we cross the reducibility hyperplane H lt N 
(cf. |Yee05| . Proposition 3.2). Recall that e(H lt N,z) encodes information about 
singular vectors: if / G U(n op ) is such that fv\ generates M(Xq — Nj) = M(s 1 Xq), 
then 

s(H y , N ,z) if X t G H+ N 
-s(Hy tN , z) if X t G H~ N . 

Invariant Hermitian forms on Verma modules are unique up to a real scalar, which 
is determined by the inner product of a generator with itself. The proposition now 
follows from the observation that xX = s a sxX and xA = s xa xsX. □ 

Corollary 4.1.2. Letting s = s a be a simple reflection, the signed Kazhdan-Lusztig 
polynomials satisfy: 



sgn(/vA t - P ,/w At 



p, J "M-p/\ t 
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a ) p wyx,w xy = sgn{-wp,xa)e{H xct ^ xs x, xo ^),xs)P^ xs ^ y ifys > y andx,xs > 
V 

a ') P w™x,wxy = s 9 n (- w P, a ) £ ( H a.Xsx\, a v),sx)P*f sxwyu if sy > y and x,sx > 

y- 

An excellent companion for the remainder of this section is |GJ81| from which 
the results of this section are derived. The objective is to compute P^ x Wxy for 
case b) . We begin by introducing some background material. 

4.2. Category O. Bernstein- Gclf and- Gclf and defined category O in |BGG76| . It 

is the subcategory of the category of g-modulcs consisting of modules M satisfying: 

(1) M = ®^M, L 

(2) M is finitely generated 

(3) M is n-finite (i.e. U(n)v is finite-dimensional for every v £ M). 
Category O is closed under arbitrary direct sums, quotients, submodulcs, and ten- 
soring with finite-dimensional modules. Verma modules are objects in category O 
and the simple objects of O consist of the irreducible highest weight modules L(/j,) 
where fi £ f)*. Irreducible highest weight modules form an additive basis of the 
Grothendieck group of category O. 

f)* is a disjoint union of W-orbits which are called blocks. Recall that = Xv 
if and only if v £ W/i. For each block D and some /i £ D, we define 

O d := := {modules eO\3N such that (z - x^) N annihilates MVz £ Z(g)}. 

Remark 4.2.1. These blocks are larger than the standard ones in ring theory: two 
irreducible modules belong to the same block if they admit a non-trivial extension 
in the category. In the case of category O, this amounts to two irreducible highest 
weight modules having the same infinitesimal character and all of their weights 
differing by sums of roots. 

Category O decomposes into blocks Od of category O: 

Theorem 4.2.2. (cf. |BGG76| . property 4) of Section 3) 

0= On. 

blocks D 

Denote projection onto On (or O^) by Prjj (resp. Pr^). Projection onto the 
blocks of category O defines what is known as the primary decomposition 

M ~ Pr D M 

blocks!) 

of a module M in O. For any M £ O, PrnM is non-zero for finitely many D. 
ProM is called the primary component of M with respect to the block D. 

Theorem 4.2.3. (cf. |,Ian74| . Satz 1, iv) of Section 3.) Primary decomposition of 
a module in category O which admits an invariant Hermitian form is an orthogonal 
decomposition into submodule pairs or singletons. Specifically, 

ProM and Pr^'M are orthogonal for D' =/= —D. 



Proof. It is straightforward to modify Jantzen's proof that primary decomposition 
of modules in category O admitting a contravariant form is an orthogonal decom- 
position. □ 
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4.3. Jantzen's translation functors and his determinant formula. For an 

integral weight fj,, let F(n) denote the finite-dimensional representation of extremal 
weight (i. Jantzen's translation functors are compositions of tensoring with a finite- 
dimensional module with projections onto blocks of category O: 

T\ +M : {modules of inf '1 character A} — > {modules of inf'l character A + /*} 

M ^ Pr x+ „(M (» F(p)) 

for any Aef)* (cf. IKos75j ). We will later use T§' in place of T£' when A and A' 
are both antidominant, and therefore the value of A' — A may be recovered. 

Recall for A G f)* that A A (fl, f)) = {a G A(g, f))| (A,a v ) G Z}. A facette J" is a 
non-empty subset of some A(A) := QA A (g, t)) ®qR associated with a disjoint union 
A+( g ,f)) = A^UA+UA- 

(a;,a v )>0 if a G A+ I. 
(x,a v }<0 if«£ J 

If M is irreducible, A and A + /x are antidominant with A + /i in the closure of the 
facette containing A, then T, +fl M is irreducible or zero f |Jan79| . Theorem 2.11). 
If both A and A + fi are strictly antidominant. then y^ +A1 : 0\ — > Oa+^ is an 
equivalence of categories. 

We may extend the translation functor to category O: 

jA+M ■ Q Q 

M ^ Pr x+fi (F(ii)®(PrxM)). 

In order to study how Jantzen's translation functors affect Verma modules and 
forms on Verma modules, we need some facts about the tensor product of a Verma 
module M(A) with a finite-dimensional module F: 

Theorem 4.3.1. (Bernstein- Gelf and- Gelfand, |Dix96| , Theorem 7.6. 14-) Let n\, 
. . ., /Ltjv be an ordering of the weights of F (with multiplicity) such that < fij 
implies that i < j. Then there is a filtration of M = M(A) ® F by Verma modules: 

M = M° D M 1 D ■ ■■ D M N D M N+1 = {0} 

where M l /M l+1 ~ M(A + in). 

Theorem 4.3.2. f |Jan74| . Satz 1, Hi) of Section 3.) Let Mi be Prx +IM M. Then 
Mi is generated as a U(n op ) -module by the images of v\- p ® F v where v is a weight 
of F such that A + v belongs to the Weyl group orbit of A + . 

Suppose the modules U and V admit an invariant Hermitian (resp. contravari- 
ant) form. The tensor product of the two modules U '(g) V naturally has an invariant 
Hermitian (resp. contravariant) form: (u\ ® w 1 ,m 2 ® v^iu^y = {ui,U2) u -{vi,V2) v ■ 
Since primary decomposition of a module is orthogonal with respect to invariant 
Hermitian forms in the case of a compact Cartan and also with respect to contravari- 
ant forms, the MjS inherit invariant Hermitian forms from invariant Hermitian 
forms on M(X) and on F, and they inherit contravariant forms from contravariant 
forms on M(A) and on F. Jantzen has a determinant formula for such contravariant 
forms: 



T= < x G A(A) 
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Theorem 4.3.3. / |.Tan74| . Section 5.) Suppose the numbers (A, a v ) for a G II 

are algebraically independent over Q. Suppose F = L(Ao) where Ao G A is strictly 
dominant and let vq be a highest weight vector of F so that (vq,vq) = 1. Let n(fi) 
denote the multiplicity of the weight fi in F and let {s-ij,,j}i<j<n<n) be a L-basis of 
the fi weight space of U (n op )zvo . (i = [ii for some i. Denote by f^.j the orthogonal 
projection of v\- p (8 e p j onto Mi . The determinant of the contravariant form for 
the fpj is Dp(n)a^, where Dp([i) is the determinant of the contravariant form 
with respect to a "L-basis of U(n op )zVo, and thus for the e^j, and 



*= n n 

a6A+(g,l)) r>0,r+<^i,Q v )>0 



(A,a v )-r \"^+™) 



(A + /i,a v ) +r 



We now compare the canonical contravariant form with the Shapovalov form 
for the purpose of stating Jantzen's determinant formula for invariant Hermitian 
forms. We begin by introducing a Z2-grading of A r in the case of a compact Cartan. 
From [6,6] C 6, [6,p] C p, [p,p] C 6, and from [g a ,g^] C Qa+p, we see that a root is 
non-compact if and only if when expressed as a sum of simple roots, there are an 
odd number of non-compact roots in the sum, counting multiplicity. It follows that 
for any fi G A r , the parity of the number of non-compact roots in any expression 
of (i as a sum of roots is independent of the expression chosen. We will denote the 
grading defined by this parity by e : A r — > Z2. 

The Chevalley basis may be chosen so that 

x* = -x a = ev a = {-\y^Y a = (-iy^o(x a ) 

(cf. |Yeef)5| L Thus 

Lemma 4.3.4. // () is compact and we choose a L-basis from U(n op )zvx- P for 
(M(A)z) M , matrices representing the canonical contravariant form and the invari- 
ant Hermitian form with respect to this basis differ by multiplication by the scalar 

Proposition 4.3.5. When f) is compact, Theorem \4 ■ 3. 3\ holds with "invariant Her- 
mitian form" in place of "contravariant form" and (— l) e ( A n-p-M)«(A') a ^ j n pl ace j 

Proof. A vector of weight A — p + /i in M(A) <E) L(Ao) must be the sum of tensor 
products of a vector of weight A — p — v and a vector of weight /i + v for some v G A,.. 
The proposition now follows from the grading, the lemma and the observation that 

( — l) £ ( Iy )+ e ( A °-P-(P+ iy )) — (_1 )£<>o-p-m), □ 

4.4. Gabber and Joseph's generalization of category O. For the purpose of 
studying the Kazhdan-Lusztig Conjecture, Gabber and Joseph introduced modifi- 
cations of category O. Let C C t) A be of the form A + A r (recall the discussion of the 
setup of |GJ81| after Theorem l2.2.1|) . Let K c be the subcategory of L r (g^)-modulcs 
M such that: 

1) M = ^ eC _ p M fi 

2) M is U(n A )-finite 

3) M is finitely generated over U(2a)- 

Note that M(X) A belongs to ObA'c- 
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If [i G C, given any maximal ideal m of A, there is a unique maximal submodule 
of M(ii)a containing mM{y?)A (cf. 1.7.2 of |G.I81j ). Call the corresponding simple 
quotient L(m, /i). In our case, A is a local ring, so we use L(/j)a in place of L((t), /x). 

A block in the context of the category Kc is a subset D of C whose specialization 
at t = 0, D = {A | A G D}, is a VK-orbit. Define 

j d = f] kerx^- 

We may define, as we did for category O, the primary component of M £ Obifc 
with respect to the block Z?: 

Pr D M = {me M\ for all z G Jd, exists n G Z + such that z™m = 0}. 

We note that C = D, is a countable union of blocks. As for category O: 

Proposition 4.4.1. (cf. Proposition 1.8.4, |G,I81| ) For M G ObA'c, we ftawe 

M = ® t Pr Di M, 

the primary decomposition of M. 

Given a block D C C, the subcategory J\£> of ifc 1 consists of modules whose 
simple quotients are among the L(m, fi) where m is a maximal ideal of A and ^ e D. 
Pro takes objects in ifc to objects in Kd- 

In |G.T81j , Gabber and Joseph extended Jantzen's definition of translation func- 
tors to category Kc- Let D = W\X + St, where A,<5 G t)* are regular and A is 
antidominant. Let D' = W\(X — fx) + St, where /i G A and A — fi is antidominant. 

Tg'M = Prjy(F(-n) A ®a (Pr D M)) 

is the translation functor from the block Krj to the block Kr>'- 

We refer the reader to Definition 2.3 of |Yee05j for the definition of the Hermitian 
dual of a module. Given a module M in ObJ-Qj, we define S h (M) to be the fj-fmite 
part of its Hermitian dual M h . 

Lemma 4.4.2. Let M G ObKg for some block D C C. If M admits a non- 
degenerate invariant Hermitian form and f) is compact, then 5 h {M) = M. 

Proof. We may modify Section 3.10 and Lemma 4.7 (iii) of |GJ81| . □ 

4.5. Coherent continuation functors. Suppose A G fj* is antidominant and 
regular and S G h* is regular. Let D = W\X + St. Let s = s a be a simple reflection 
in W\. We may choose v a G A so that A — v a is antidominant and so that the only 
root (3 for which (A — v a ,j3) = is f3 = a. Let D a = W\(X — v a ) + St. Since we 
are studying invariant Hermitian forms, we assume furthermore that i5 and A are 
imaginary, although the statements which follow hold for non-imaginary S and A 
if they contain no reference to invariant Hermitian forms. We fix this notation for 
the remainder of this article. The generalized notion (it exists for category O also) 
of translation to the a wall is the functor 

Tp a M = Pr Da {F{-v a ) A ® A (Pr D M)) 

and 

Tg a M = Pr D {F{v a ) A ®a (Pr Da M)) 
is translation from the a wall. Translation to the a wall followed by translation 
from the a wall, denoted by 9 a = Tg T D " , is an exact functor known as coherent 
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continuation across the a wall or the reflection functor across the a wall. 

We will also use 8 a to denote coherent continuation in category O. Due to results 
in sections 14 . 21 and FOl if M carries an invariant Hermitian form, then so do T^ a M, 
M, and 9 a M naturally. We use T (■, ■) to denote the form which results from 
application of the translation functor T to a module with invariant Hermitian form 
(",■>■ 

We would like to describe the form which arises from a translation functor when 
the module and its invariant Hermitian form are a Verma module and its Shapovalov 
form respectively. For any z G W\, 

TE a M(zX + 5t) A ~ M(z{X - v a ) + 6t) A 

by Satz 2.9 of |Jan79| . We define 

(4.5.1) v 'z(x-u a )+st- P : = p rD a v z \+6t-p ® e- ZVaA , 

("J ')z(X-u a )+St :== T d" ('i ')zX+6t ' and 

(4-5.2) 4 := {v' z{x _ Va)+St _ p , v' (x _ Va)+St _ p ) z{x _^ +st . 

Let A~ G A + be the highest weight of F(—v a ). According to Theorems 14.3.21 and 
14.3.31 and Lemma T4. 3. 41 the form (•, -) z (\_ v ) + g t on M(z(\ — v a ) + St) a is such that 

c' z = (-iy^+^D F( _ Va) (-zu a )a'_ ZVa 

where 
(4.5.3) 

(z\ + 5t,/3 v ) -r 



(zX - zv a + 6t,f3 v ) + r 



n{ — zv a -\-r{: 



a> -». = n n 

0GA+(o,[)) r>0,r+(-2i/ Q , / 9 v )>0 

On the level of signature characters, we have 

( 4 - 5 - 4 ) ch s{-, ■)l(A-v e ,)+« = sgn{c' z )ch s (•, -) z{x _ Ua) . 

Here, we observe that Jantzen's determinant formula holds in the category Kq 
setting also since we work with U(n op )z bases and hence his projection formulas 
and recursive formulas hold (cf. |Jan74| . Section 5). 

Returning to the problem of developing a recursive formula for signed Kazhdan- 
Lusztig polynomials in case b), we fix x,y G W\ such that y > ys and x < xs for the 
remainder of this section. Following the notation of |(t.T81| . let X = M{xs\ + St) a 
and let Z = M{xX + St) A - Define Y to be 6 a Z. Then: 

Proposition 4.5.1. / |GJ81| . section 3.6.) 

i) 6 a X ~e a z ~y. 

ii) There is a short exact sequence 

Remark 4.5.2. Because of the short exact sequence, Y is called an extension of 
X by Z. 

Remark 4.5.3. Gabber and Joseph's results are for contravariant forms. The in- 
variant Hermitian form analogues of their results hold in the compact Cartan case: 
their proofs may be transferred to the Hermitian form setting using Lemma l2~2~2l 
and Theorem IT2~3l 
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We review Gabber and Joseph's discussion of the filtration of Y by Verma mod- 
ules. Now for x' £ W\, 

(4.5.5) [Tg a M{x(X - u a ) + St) A : M(x'X + St) A ] = dim(F(i/ a ) A ) M 

where /i = x'X — x(X — v a ) = x'X — xs(X — v a ). According to Satz 2.9 of |Jan79| . 
there are two solutions: x' = x, fx = xv a and x' = is, /i = xsv a . By Theorem 14. 3 .21 

Y is generated as a U(n op ) module by v£ x+gt _ p = Pr Da (y' x(x _ Va)+St _ p ® e XVa ,i\ 

and by < aA+4t _ p = Pr Da (v' x{x _ Ua)+S t- P ® e ^o,i) • Observe that v£ x+st _ p and 
< s A+5t-p are mutually orthogonal with respect to (•, -)" D := T% a (•, •)l (A _ I/a)+(5t . 



Recall c' x = ^< (A _„ a)+Jt _ p , u*(A_„ a ) + dt-p/ x(A _„ a)+w - Let A « e A be the higl> 
est weight of L(A+)a = F(^ Q ) J 4. From Theorem 14. 3 .31 we have 

«A+«-^»«xA+«-p>d = (-^^""^^n^^K^X and 

where 

( {x\ + 6t,p>)+r ) 



n 

a xv a 



,3eA+ r>0,r+(xv a ,[3 v )><3 

n n 

/3GA+ r>0,r+(:csi; Q ,/3 v )>0 



(xs(A-^) + ^,/3 v )- ^ ^»«"-+^ s ) 
(xsA + <ft,/3 v ) + r 



We compute which factors are zero at t = 0. 

Denominator of : We require r and (3 > such that (xA,/? v ) = — r < 0. Then 
S/3xA — xX = r/3 so s^xA — x(A — i/ a ) = xv a + r/3. From (|4.5.5J) and from part 
ii) of Thcorcm l4.5.1l we see that 



n(xv a + r/3) 



1 if spx = xs a f3 = xa 
otherwise. 



We conclude that the denominator has exactly one factor, (St, xa v ), which is 
zero at t = 0. 

Numerator of a xv : Suppose we have (3 > and (x(X — v a ),(3 y ) = r > 0. Then 
x(X — v a ) — spx(X — Va) = r(3 so spxv a — rf3 = spxX — x(X — v a ). By l|4.5.5|) 



and by part ii) of Theorem 14. 5. II 

n(xv a + r/3) = n(sf3xv a — r/3) 



1 if spx = xs a => (3 = xa 
otherwise. 



However, (a;(A — v a ),xa y ) — ^ r and we deduce that the numerator has no 
factors which are zero at t = 0. 

Similarly, none of the factors in the numerator and the denominator of a" s „ are 
zero at t = 0. 

Remark 4.5.4. The results of this section hold with any z < zs in place of x. We 
define v% x+st _ p , v' z ' sX+St _ p , a" ZVa , and a" ZSVa analogously for all such z G W\. 
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4.6. A recursive formula in the difficult case. Here, we combine the results 
of the preceding subsections to deduce a recursive formula for computing signed 
Kazhdan-Lusztig polynomials for case b). 

We will need Gabber and Joseph's description of Yj where the form on Y arises 
from the form on Z and coherent continuation (cf. 4.4. 4.5, 4.6 of |GJ81| ). Recall 
the exact sequence from Theorem 14.5.11 If we define Y? = (Y^ n X)/{Y^ +1 n X) 
and Y* = k(Y : ')/tt(Y 3+1 ) then there is a short exact sequence 

-> Yf -> Yj -> Y" -> 0. 

For M G ObKc, we define M + (resp. M~) to be the smallest (resp. largest) 
submodule of M for which 6 a (M/M + ) = (resp. 6 a M~ = ). We have the short 
exact sequences 

and 

(cf. 4.5 (2), 4.5 (4), Lemma 4.6 ii) and Proposition 4.7 of |GJ81| ). This gives us 
the four-step filtration of Yj : 







Y z 




*7 







Here we remark that in the paper |G.T81j . because 3.14 still holds and because we 
may modify Lemma 3.15 for invariant Hermitian forms, Hermitian analogues of 
results in sections 4.4 to 4.7 hold. We have: 

Lemma 4.6.1. (cf. |G J8l| ■ Lemma 4-5.) 

i) (X+ +1 ,Yf) = 

ii) {X+ +1 ,kcT(Y^Z+)) = 0. 

Furthermore, 5 h (Xf +1 ) = Z+. It follows that: 

Proposition 4.6.2. Consider the four-step filtration ofYj. X^ +1 is paired with 
Z~!f , whence the signature character of Yj is given by the signature characters of 
XJ and Z~ +1 . 

We will clarify the latter half of this statement, which is vague. First, we discuss 
the structure of X~ and Z~ +Il which is given (along with the structure of Xf~ and 
2f~ for any i) by Kazhdan-Lusztig polynomials and the following proposition: 

Proposition 4.6.3. ^ |GJ81| . Lemma 3.6, 3.11.) 

i) 9 a L(z\) = if z > zs and 6 a L(z\) ^ otherwise. 

ii) When z < zs, 9 a L(z\) has a unique simple quotient and it is isomorphic 
to L(z\). The corresponding unique maximal submodule has unique simple 
submodule L(z\). 

Recalling that Xi is semisimple, X^ is a sum of simple submodules L(zX) for 
which z > zs and X^ is a sum of simple submodules L(zX) for which z < zs. 
Likewise for Zi. 
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We study 9 a L(zX) when z < zs in more detail. The functor Tg is a left and a 
right adjoint to T® a (cf. 3.4 of |GJ81j and (3.5) of |Vog79a| ). It follows that 

Hom fl {L{z\),Tg o T^ a L{zX) S j = Hom fl (r^°'L(zX),T^ 0! L(zXfj 

= Hom fl {t^T^L{zX),L{zX)) 

from which we obtain a chain complex 

-► L(z\) A 6 a L(zX) A L(zX) -» 

(cf. | Vog79a| , Theorem 3.7). Because L(zA) is simple, the first map is injective and 
the second map is surjective. 

Since 9 a L(zX) admits a non-degenerate invariant Hermitian form (for exam- 
ple, the form acquired through coherent continuation and the form on L(zX)), 
5 h (9 a L(zX)) = 9 a L(zX). S h takes submodules of a module M to quotients of 5 h M 
and quotients of M to submodules of 5 h M. Since 8 h docs not take the submod- 
ule L(zX) of 9 a L(zX) to the submodulc L(zX) of 5 h (9 a L(zX)), it follows that that 
submodulc cannot be paired with itself, and hence it is paired with the quotient 
L(zX). We conclude: 

Lemma 4.6.4. Suppose z < zs. Then ch s 9 a L(zX) = ch s U a L(zX) where U a L(zX) 
is defined to be the cohomology of the complex 

L(zX) ^ 9 a L(zX) -» L(zX) -> 0. 

U a may be extended to semisimple modules via U a {M © N) = U a M © U a N. In 
particular, we may apply U a to Zj. Since 9 a M^ = (9 a My for M G ObKc (cf. 
|GJ81j . Lemma 4.3 ii) ), we see that Yj = 9 a Z ] = 9 a Z+. 

Proposition 4.6.5. (cf. |G.T81j . Proposition ^.7 iv).) There is a short exact 
sequence 

0^X7^U a Z+^Z7 +1 ^0. 
Furthermore, choosing the form 9 a (•, -) x x + st on ^ ' 

ch s Yj = ch s U a Z^ = sgn{c xs c x )ch s X~ + sgn(c"(5, xa y )c x )ch s Z~ 
where for z < zs 

and c'i, := (-l)^t— ) D F[Va) {zsv a )al Va . 

Proof. This follows from our previous discussion, Theorems 14.3.21 and 14.3.31 and 
our analysis of a!' zv and a!' zsv . □ 

We discuss the signature character of an invariant Hermitian form on some 
U a L(zX). The process of coherent continuation in category O uniquely determines 
an invariant Hermitian form on U a L(zX) from a form on L(zX). Since U a L(zX) is 
semisimple by Vogan's Conjecture, it may have many other non-degenerate invari- 
ant Hermitian forms. For example, another natural form on U a L(xX) is the form 
on Yq which arises from the Jantzen filtration of 9 a Z = 9 a M(xX + St). The signa- 
ture depends on 5 while the form coming from coherent continuation in category 
O does not, and so the signatures may be different. The form given by the Jantzen 
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filtration is the form in which we are interested. In the following computations, we 
will always study the form arising from the Jantzen filtration. 

We compute the signature character of the form on (8 a M(zX + St)) = 9 a L(zX) 
for z < zs. By Proposition 14.6.51 there is a short exact sequence 

M(zs\ + 6t)~ -> U a M(zX + St) Q -> M(zX + 8t)~ -> 0. 

By ch s U a M(zX + St) we mean the signature character of the form given by the 
Jantzen filtration in the direction S. By our analysis of the denominators and 
numerators of a" zv and of a" s „ a , the denominators of c" and c" s do not vanish at 
t = 0. From Jantzen's determinant formula and our short exact sequence above, 

ch s U a M(zX + St) = sgn(c^ s c? z )ch s L(zsX) 

+ sgn(c" (5, za w )c' z ) ^2 a z y X { w ch s L(yX). 

yew x \y>ys 

Using this in conjunction with the previous proposition gives: 
Proposition 4.6.6. If x,y G W\ are such that x < xs and y > ys and x > y then: 
sgn{cZ s c' x )P^ Wxy {q) + sgn(e£(tf, xa v )c' x )qP^ Wyy (q) 

sgn(c z (5,za )c z )a y { q * P w \ x , Wx M) 

z£W\\z<zs 

+ sgn(^ s (S, ysa v )c' ys )P^ Wxys (q)- 
We discuss the values of sgn(c"), sgn(c zs ) and sgn(c z ) for z < zs. 
Lemma 4.6.7. For an integral weight v and for all w G W , 

sgn (D F ( v )(wu)) = 1 
(see Theorem \4 ■ S. £\ for notation). 

Proof. We prove this by induction on £(w). Clearly this is true for iv = 1. We may 
assume v to be dominant and let v v be the canonical generator of F(y). Suppose 
the lemma holds for w G W and s a is a simple reflection such that s a w > w. Let 
a G U(n op ) be such that av v is a vector of weight wv in F(v). Now s a w > w, so 
(wis, a v ) > 0. Let n a = (wv,a v ) = (i/, w _1 o; v ) G Z-. s a wv = wv — n a a and so 
Y™ a av v is a vector of weight s a wv in F(y). Because av v is a vector of extremal 
weight wv and because the set of weights of F(y) is convex, Y™ a av u G F{y) implies 
X a av u = 0. Therefore 

{Y^av v ,Y^av v ) = {a{Y^ a)Y r ^ av v , v v ) = (a{a)X^Y^av v , v v ) 
(from X a av v = 0) = (CT(a)p(X™°Y Q "°)a^, u„) 

(from theory) = wv (H a (H a — 1) • • • (iJ Q — (n a — 1))) • (cr(a)av v ,v v ). 

Now u)f (i/^ (i7 Q — 1) • • • (H a — (n a — 1))) > since wv(H a ) = n a . By our in- 
duction hypothesis, (o(a)av Vl v v ) > 0. Thus (Y£ a av v , Y£ a av v ) > 0, proving our 
lemma. □ 

Remark 4.6.8. We may also prove the lemma using the following unpublished re- 
sult of Birgit Spch: if t) is a compact Cartan subalgebra, then given the finite 
dimensional representation of highest weight Ao, the Shapovalov form is definite on 
each weight space, with the form being positive definite (resp. negative definite) 
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on the Ao — /i weight space if e(/x) = (resp. e(p) = 1). Again, we may take 
v to be dominant. Comparing what Speh's formula and Lemma 14.3.41 imply for 
the signature of the one-dimensional weight space corresponding to wis, we have 
(_iy(»-wu) = sgn {D F(l/) {wv))(-l) £{u - wu) from which the lemma follows. 

Lemma 4.6.9. For z < zs £ W\: 

i) sgn( a'_ zt/ J = 1. 

ii) sgn(a'£ Ua (5t, za v )) = -1. 
hi) sgna' z ' SJ , Q = 1. 

Proof, i): Consider (|4~53jl . If (-zv a ,f3 v ) > then n{-zv a + r/3) = for r > 0. If 

(— zv ai [3 v ) < 0, then the index for the second product starts at r = — (— zv ai /3 V ). 

-zv a - (~zv ai /3 v )l3 = sp{-zv a ) 

is an extremal weight of F(—v a ). Therefore n(—zv a +r0) = for r > —{—zv a , f3 v ). 
Therefore a'_ z „ may be written 



n 

,36A+( B ,I,),(-zfc,,/3 v )<0 

n 



(zA,/3 v ) + (^ a ,/3 v ) ^ : 
{z\-zv ai ^)-^zv a ,^) 

(^(A-^),/3 v ) 



(zA,/3 v ) 

A — v a lies in the closure of the antidominant Weyl chamber, which is the Weyl 
chamber to which A belongs. Since (A — v a ,(3 y ) ^ for [3 ^ a, we conclude that 
sgn(z(A — v a ), (3 W ) = sgn(zA, /3 V ) for j3 ^ za. Observing that (— zv a , za y ) > 0, we 
conclude that sgn(a'_ zi , a ) = 1. 
ii): As in the previous case, 



so sgn(a' z ' !yQ (8t, za v )) = — 1. 
iii): As in the hrst case, 



n 



(zsA,/3 v ) 



Since {zsv a , z« v ) > 0, we conclude that sgn(a" s „ Q ) = 1. □ 

Combining the results of this subsection, cancelling out common factors of 
(— l) £ ( A n+ A a ), and observing that xv a — xsv a = x((v a , a v )a) = x((X, a v )a), we 
arrive at: 

Theorem 4.6.10. Letting s = s a be a simple reflection, the signed Kazhdan-Lusztig 
polynomials are defined by the intial conditions P£'™ = 1, P x 'y = for x > y and 
the recursive formulas: 

a ) p wfx,w xy = sgn(~wp,xa)e(H xa _ {x ^v ) ,xs)P*f XS Wxy if ys > y and xs > 
x>y 

a ') p wyx,w xy = s 9 n (-wp,a)e{H at{sxXta v } ,sx)P^f SXtWxy if sy > y and sx > 
x>y 
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b) If x,y G W\ are such that x < xs and y > ys and x > y then: 
(-iy((^)^P^ xs wxy ( q ) + sgn(5, x^)qP^ Wxy ( q ) 



z£Wx\z<z 



5. Some Examples 



Example 1: g = so(2). We have f) = t. Let A + (g, t)) = {«i} and let Ai be the 
corresponding fundamental weight. 

Irreducible Verma modules: Choose A G f)* so that (A, ) (n,n+ 1) where 
n G Z>o- Then A £ A(nAi, Wo). The reducibility hyperplanes separating the 
alcove aAo containing A and aAg are H ait i, H ai ,2, ■■■ H ai , n . In the setup of 
Theorem 13 . 2 .41 we choose the path so that ri = s Ql> „, r2 = s ai: „_i, . . ., r„ = s aii i. 
Suppose Sc{l,2,...,ii} and 15*1 > 2. Then Tj^Ci 2 -i and T\ld 2 lie in the Wallach 
region, and thus e(Ti^Ci 2 -i 1 r r i^Ci 2 ) — 0. Therefore e(S) = for |S| > 2. For our 
choice of path, note that C, D (n — i, n — i + 1), whence — e(C,_i,Ci) = 

£(-ffai.n-i+i, Si) = = 1 (see Definition 5.2.16 and Lemma 5.2.17 or Theorem 

6.12 of |Yee05) ). Substituting these values into Theorem 13. 2. 41 



R A(n\ u w ) = chs M{\) = 



Th=i 2e r ' riX - p + e x - p 



n i 1 -^) n (i-^) 

o£A+(p,t) a£A+((,t) 

1 + e" Q i 
y^" g A— (t— l)ai — p _|_ gA— iai — p 

1 + e~ Ql 



e A-p _|_ gA-p-ai-p j , gA-(n-l)a 1 -p 



gA— nai- p 
1 + e" a i ' 

Irreducible highest weight modules: Let A = — n\\ for some n G Z + . Since A is 
in the Wallach region, taking n = in the above formula: 

ch s L{\) = ch s M{X) = 

According to Theorem 

1 = P^ = sgn(-w oP , ai )e(H aun , Sl )P x ^ Wo = S^P x ^ Wo = P x ^ Wo 

by Lemma 5.2.17 or Theorem 6.12 of |Yee05| . Substituting the values we have 
computed into Theorem 13. 2. 31 

ch s L{s x \) = R A ^ w °\ Sl \)~P^ uwo R A{X ' Wo) W 

= R A{nX ^ Wa) ( Sl X) - R A ^ nXl ' Wo) ( Sl X - nai) 
= R A ( nXl > wo) ( Sl X) - R A (° Xl > W0 \si\ - na x ) 



; »iA-p _|_..._|_ gSiA-(n-l)ai-p _|_ 



gSiA— nai— P\ ZgSiA— nai— p 



1 + e- Q i 

e siA-p , e siA-ai-p i ... i gSiA-(n-l)ai-p 
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ch s L(jj) 



ch s M{p) 



e n e M e v 

Ai 2Ai 3Ai 

• • M 



— • 



H ai ,l -"cei,2 -"ai,3 





e" 














i gjll— 2ai 


gAi— 2ai 


_l_g/i— 2c«i 


+ e M-"i 


_gA'-3ai 




_g/i— 3ai 






_ e M-4ai 




_ e /j-4ai 




Figure 1. 


5U(2) 





Example 2: g = sI(2,K). We may proceed as in the previous example, but 
substitute S ai = — 1 instead of S ai = 1. 

Irreducible Verma modules: For A 6 t)* such that (A, ) € (n, n + 1) where 

n € Z> : 

J =i— — — 

n a-«- a ) n ( i+e_Q ) 

QSA+(p,t) aeA + (t,t) 

Er=i(- i ) i2eA_Mi_p + eX ~ p 



1 - e- Q i 

_ gA-p _ gA-jo-ai-p _|_..._|_ /-^•jn-lgX-(n-l)ai- / 3 _|_ 

Irreducible highest weight modules: For A = — n\i where n 6 Z + : 
c/i s L(A) = ch s M(\) 



gA— nai -p 
1 - e- ai ' 



e A-p 



1 - e- Q i 
Since P^° So = (-1)", we have 

ch a L( 8l A) = i? A(siA '"' o) (siA)-F^:" fl A ^°)(A) 



„siA — ncti— p \ / p siA- ncti— p 



\J2(-iy e ^-^-p + (-i)" - — j - (-i) 

e siA-p _ gSjA-Qj-p _|_..._|_ ^_^yn-l e siA-(n-l)a 1 -p 
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ch s L(/j.) 



ch s M(p) 



Ai 
— • — 



2Ai 



_ e H-ai 

3Ai 



H, 



Ql ,1 



H, 



ai,2 



H, 



Ql ,3 



















_|_ e /j-2ai 


gAi— 2ai 


_|_p^-2ai 






_ e A<— 3cti 


_ e /i— 3ai 


-LgM— 3ai 




_ e M-4ai 


_ e ^t-4ai 


_ e /j-4ai 




Figure 2. 
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